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(54) Title: METHOD AND APPARATUS FOR DISPLAYING PROGRAM RECOMMENDATIONS WITH INDICATION OF 
STRENGTH OF CONTRIBUTION OF SIGNIFICANT ATTRIBUTES 

(57) Abstract: A method and apparatus are disclosed for displaying available television programs with an indication of the strength 
of the contribution of one or more program attributes or features to the overall recommendation score assigned by a program rec- 
ommender. The program and corresponding indication of the strength of the contribution of one or more program attributes can 
be presented to the user, for example, using grids listing the available television programs by time and date, channel and title. The 
overall recommendation scores or component scores associated with each program are also displayed to the user. The overall rec- 
onmiendation scores or component scores can be displayed with each program directly or can be mapped onto a color spectrum or 
another visual cue, such as a variable size-of-text, rate of blinking or bar height. The visual cues are then applied to each program in 
the program grid in accordance with the present invention. 



wo 02/37840 PCT/EPOl/12099 

1 

Method and apparatus for displaying program reconunendadons with indication of strength 
of contribution of significant attributes 



Field of the Invention 

The present invention relates to television program recommenders, and more 
particularly, to a method and apparatus for displaying television program recommendations. 



5 Background of the Invention 

As the number of channels available to television viewers has increased, along 
with the diversity of the programming content available on such channels, it has become 
increasingly challenging for television viewers to identify television programs of interest. 
Historically, television viewers identified television programs of interest by analyzing printed 

10 television program guides. Typically, such printed television program guides contained grids 
listing the available television programs by time and date, channel and title. As the number of 
television programs has increased, it has become increasingly difficult to effectively identify 
desirable television programs using such printed guides. 

More recently, television program guides have become available in an 

15 electronic format, often referred to as electronic program guides (EPGs). Like printed 

television program guides, EPGs contain grids listing the available television programs by 
time and date, channel and title. Some EPGs, however, allow television viewers to sort or 
search the available television programs in accordance with personalized preferences. In 
addition, EPGs allow for on-screen presentation of tiie available television programs. 

20 While EPGs allow viewers to identify desirable programs more efScientiy 

than conventional printed guides, they suffer ftom a mmiber of limitations, which if 
overcome, could further enhance ftie ability of viewers to identify desirable programs. For 
sample, many viewers have a particular preference towards, or bias against, certain 
categories of programming, such as action-based programs or sports programming. Thus, the 

25 viewer preferences can be applied to the EPG to obtain a set of reconamended programs that 
may be of interest to a particxilar viewer. 

Thus, a number of tools have been proposed or suggested for recommending 
television programming. The Tivo™ system, for example, commercially available from Tivo, 
Inc., of Sunnyvale, California, allows viewers to rate shows using a "Thumbs Up and 
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Thumbs Down" feature and thereby indicate programs that the viewer likes and dislikes^ 
respectively. Thereafter, the TiVo receiver matches the recorded viewer preferences with 
received program data, such as an EPG, to make recommendations tailored to each viewer. 

Thus, such tools for recommending television programming provide selections 
5 of piograms that a viewer migjit like. Even with the aid of such program recommenders, 
however, it is still difficult for a viewer to identify programs of interest from among all the 
options. In particular, for a givra recommended program, such program recommenders do 
not mdicate the program features that most contributed to the recommendation score. A need 
Aerefore exists for a method and apparatus for displaying television program 
10 recommendations in a more efficient maimer. A further need exists for a television program 
recommender that provides an indication of the strength of the contribution of one or more 
program attributes or features to the program recommendation score. 

Summary of the Invention 

1 5 ' Generally, a method and apparatus are disclosed for displaying available 

television programs with an indication of the strength of the contribution of one or more 
program attributes or features to the overall recommendation score assigned by a program 
recommender. The program and corresponding indication of the strength of the contribution 
of one or more program attributes can be presented to the user, for example, using grids 

20 listing the available television programs by time and date, channel and title. 

According to one aspect of the invention, the overall recommendation scores 
or component scores associated with each program are also displayed to the user. The overall 
recommendation scores or component scores can be displayed with each program directly or 
can be mapped onto a color spectrum or another visual cue, such as a variable size-of-text, 

25 rate of blinking or bar height, that permits the user to quickly locate programs of interest. Hie 
visual cues are then applied to each program in the program grid in accordance with the • 
. present invention. 

A more complete understanding of the present invention, as well as further 
features and advantages of the present invention, will be obtained by reference to the 

30 following detailed description and drawings. 



Brief Description of the Drawings 

FIG. 1 illustrates a television programming recommender in accordance with 
the present invention; 
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FIG. 2 illustrates a sample table from the program database of FIG. 1; 

FIG. 3 illustrates a hierarchical decision tree that positions the various 
attributes of television programs in the tree based on a ranking of the entropy of each 
attribute; 

S FIG. 4 is a user profile based on the hierarchical decision tree of FIG. 3 ; 

FIG. S is a flow chart describing an exemplary display recommendation 
process embodying principles of the present invention; 

FIG. 6A is a sample table from the electronic program guide in accordance 
vnlh one embodiment of the invention; 
10 FIG. 6B is a sample table from the electronic program guide in accordance 

with a second embodiment of the invention; and 

FIG. 6C is a sample table from the electronic program guide in accordance 
with a third embodiment of the invention. 

15 Detailed Description 

FIG. 1 illustrates a television programming reconmiender 100 in accordance 
with the present invention. As shown in FIG. 1, the television programming recommender 
100 evaluates each of the programs in an electronic programming guide (EPG) 1 10 to 
identify programs of interest to a particular user. The set of recommended programs can be 

20 presented to the user using a set-top terminal/television 1 SO, for example, using well known 
on-screen presentation techniques. 

According to one feature of the present invention, the available programs are 
displayed together with an indication of (i) the overall recommendation score, (ii) the 
strength of the contribution of one or more program attributes or features to the overall 

25 reconomendation score, or (iU) a combination of the foregoing. In other words, the present 
invention optionally indicates the most significant feature(s) that actually contributed to the 
recommendation of a given program. 

The programs can be presented, for example, using grids listing the available 
television programs by time and date, channel and title. The strength of the contribution of 

30 one or more program attributes to the overall program recommendation score is also 
presented in the program grid. For example, a predefined number of program attributes 
having the highest component score can be presented for each program. In further variations, 
the contribution of one or more program attributes to the program recommendation score can 
be mapped onto a color spectrum or another visual cue, such as size-of-text or rate of 
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blinking, that pennits the user to quickly locate programs having attributes of interest. In yet 
another varwtion, the strength of tiie contribution of one or more program attributes to the 
program recommendation score can be mapped onto a variable brightness scale (gray scale). 
These visual cues can then be applied to each program in the program grid. It is noted that the 
5 overall program recommendation score itself can also be mapped to such visual cues and 
presented in the program grid. 

For example, in an implementation vsrhere the television programming 
recommender 100 assigns a score betv^een 0 and 100 to each program, the overall program 
recommendation score as well as individual component scores for each program attribute can 



10 be mapped to a color spectrum or a size-of-text visual cue in the following manner: 



RECOMMENDER 
SCORE 


COLOR 


FONT SIZE/ 
THUMBS UP-DOWN 


0-15 


DARK RED 


10/11 


16-30 


RED 




31-45 


LIGHT RED 




46-55 


YELLOW 


12/=> 


56-70 


LIGHT GREEN 


14/ft 


71-85 


GREEN 


16/ft 


86-100 


DARK GREEN 


18/ft 



In a further variation of the present invention, the television channels can be 
sorted in the program grid according to a normalized reconunendation score for the time 
period being examined. For examyple, for a given half-hour time interval, the program grid 

15 can be sorted directly by recommendation score, such that programs with the highest score 
appear on the top of the program grid listing. Likewise, for tune intervals larger than a half 
hour, a normalized score can be assigned to each channel for the time period of interest and 
the program grid can then be sorted by the normalized score, such that channels with the 
highest normalized score for the time period of interest appear on the top of the program grid 

20 listing. 

As shown in FIG. 1, the television programming recommender 100 contains a 
program database 200 a user profile 400, discussed further below in conjunction with FIGS. 2 
and 4, respectively, and a display recommendation process 500, discussed further below in 
conjunction with FIG. 5. Generally, die program database 200 records information for each 
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program that is available in a given time interval* The information in the program database 
200 may be obtained, for example, from the electronic program guide 110. The illustrative 
user profile 400 contains a set of rules indicating the viewing preferences of the user that 
have been learned fiom the user's viewing history. The display recommendation process 500 
S displays the available programs together with an indication of the strength of the contribution 
of one or more program attributes to the overall program recommendation score. 

The television program recommender 100 may be embodied as any computing 
device, such as a personal computer or workstation, containing a processor 150, such as a 
central processing unit (CPU), and memory 160, such as RAM and ROM. In addition, the 

10 television programming recommender 100 may be embodied as any available television 
program reconunender, such as the Tivo™ system, commercially available from Tivo, Inc., 
of Suimyvale, California, or the television program recommenders described in United States 
Patent Application Serial No. 09/466,406, filed December 17, 1999, entitied "Method and 
Apparatus for Recommending Television Programming Using Decision Trees," (Attomey 

15 Docket No. 700772) and United States Patent Application Serial No. 09/498,271, filedFeb. 
4, 2000, entitled "Bayesian TV Show Recommender," (Attomey Docket No. 700690), or any 
combination thereof, as modified herein to carry out the features and fimctions of the present 
invention. 

FIG. 2 is a sample table from the program database 200 of FIG. 1 that records 
20 information for each program tiiat is available in a given time interval. As shown in FIG. 2, 
the program database 200 contains a plurality of records, such as records 205 through 220, 
each associated with a given program. For each program, the program database 200 indicates 
the date/time and channel associated witii the program in fields 240 and 245, respectively. In 
addition, the titie and genre for each program are identified in fields 250 and 255. Additional 
25 well-known attributes (not shown), such as actors, duration, and description of the program, 
can also be included in the program database 200. 

In addition, the program database 200 also optionally records an indication of 
the overall recommendation score assigned to each program by the television programming 
recommender 100 in field 270. In this manner, the numerical scores can be displayed to the 
30 user in the electronic program guide with each program directiy or mapped onto a color 
spectrum or another visual cue that permits the user to quickly locate programs of interest. 

For each positive and negative program example (i.e., programs watched and 
not watched by the user), a number of well-known attributes and corresponding attribute- 
value pairs are classified for the user, such as tiie time, date, duration, channel, rating, titie 
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and genre of a given program. As sho\m in FIG. 3, the various attributes are positioned in 
one or more hierarchical decision trees 301-308 based on a ranking of the entropy of each 
attribute. Generally, the higher an attribute is positioned along a given branch of the tree 
(corresponding to a rule) in the hierarchical decision tree 300, the more significant the 
S attribute. Thus, ^^dien tiie component scores are presented for a given attribute m accordance 
vsdth the present invention, &ey can optionally be presented in order of their appearance in 
the hiezarchicai tree, from the root node down to the leaf node. 

The illustrative decision tree 302 includes a root node 315 and a number of 
sub-nodes, such as sub-nodes 340, 345, 350, 355 and 360. Each node and sub-node in the 

10 decision tree 302 corresponds to a given attribute and each branch connecting two nodes 
corresponds to a specific attribute-value pair (or set of attribute value pairs). Each leaf node 
in the decision tree 302, such as the leaf nodes 370-375, corresponds to either a positive or 
negative recommendation for a program mounted at the corresponding leaf node. In addition, 
the corresponding score assigned to a program satisfying the rule is indicated adjacent to the . 

15 leaf node 370-375. 

For example, if a given program has a station_call_sign of WNBX and a title 
of ''Saturday Night," the program will be classified under leaf node 370 as a positive 
example. Thereafter, if a given program in the test data has values meeting this criteria for 
these attributes the program will be a recommended program with a score of 100.00%. 

20 The decision trees 301-308 can be built, for example, using a "top-down 

divide and conquer" approach For a more detailed discussion of the generation of decision 
trees, see, for example, United States Patent Application Serial No. 09/466,406, filed 
December 17, 1999, entitled "Method and Apparatus for Recommending Television 
Programming Using Decision Trees," (Attorney Docket No. 700772), assigned to the 

25 assignee of the present invention and incorporated by reference herein. The decision trees 
301-308 can thereafter be converted to rules and recorded in a user profile 400, shown in 
FIG. 4. 

FIG. 4 is a sample table from the user profile 400, based on the hierarchical 
decision trees 301-308 of FIG. 3, The decision tree rules shown in the user profile 400 allow 
30 the introspective analysis of the behavior of the present invention. Generally, the decision 
tree rules shown in the user profile 400 are an ordered list As shown in FIG. 4, the user 
profile 400 comprises a plurality of records, such as records 405-423, each associated with a 
different rule. For each rule identified in column 450, the user profile 400 indicates the 
corresponding score that is assigned to a program satisfying the rule in column 455. Thus, the 
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user profile 400 is traversed until a matching rule is identified. Once a matching rule is 
identified, the corresponding recommendation score is applied to the matching program. 

It is noted that an alternate implementation could allow a number of rules to be 
satisfied by a given program. Thus, in accordance with the present invention, the number of 
S satisfied rules may be indicated, as well as the attribute-value pairs contributing to each rule. 
In accordance with the present invention, discussed fiirther below hi conjunction with FIGS. 
S and 6A-6C, the attributes that contribute to the matching rule are optionally indicated 
together with the overall program score in the program grid. For example, if a given program 
has a station_call_sign of WNBX and atitie of "Saturday Night," the program will be 

10 classified under leaf node 370 as a positive example. In the program grid, the program 
recommendation score of 100.0% is indicated, together with an indication of the attribute- 
value pairs contributing to the score (station="WNBX" and titie="Saturday Night"). 

FIG. 5 is a flow chart describing an exemplary display recommendation 
process 500 embodying principles of the present invention. As shown in FIG. 5, the display 

15 recommendation process 500 mitially obtains the electronic program guide (EPG) 1 10 during 
step 510 for the time period of interest. Thereafter, the display recommendation process 500 
obtains the recommendation score fi:om the recommender 100 for each available program in 
the time period of interest during step 520. The display recommendation process 500 then 
identifies one or more of the significant attributes contributing to the program 

20 recommendation score during step 530. 

Finally, the display recommendation process 500 displays the modified 
program grid to the user during step 540 witii each available program displayed together with 
the ovmll recommendation score (or a corresponding visual cue) and, optionally, an 
indication of the contribution of one or more of tiie significant attributes to the overall 

25 recommendation score. The user can thereafter interact with the modified program grid using 
known techniques, for example, to select programs, automatically record programs or to 
program warnings that will automatically notify the user when a particular program is bemg 
presented. 

In one illustrative presentation format, the score ranges are divided up and 
30 mapped directiy to colors, in the manner described above. For example, if a particular feature 
has a score of 95, and all values between 86 and 100 are assigned the color dark green, then 
the contributmg attributes will be represented by a dark green bar. If the corresponding cell in 
the program grid is selected, then the attribute associated with the bar could appear in textual 
foma or the bar could be always displayed in the comer of the cell and only the text would 
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appear v^ea Ihe cell is selected. In a further variation, the value of the recommendation score 
or component scores would be used to set the height within a bar or the intensity of the color. 

For example, if the user profile 400 for a particular user has a rule that assigns 
a score of 100.00 to any program with tihie title "World News," then any programs appearmg 
S in the program grid with the title "World News," should be assigned a score of 100. 
Furthermore, the cell in the program grid should indicate that flxe most significant feature 
contributing to the overall score is the title itself In such a case, a color bar could be 
displayed using any of the visual cues discussed above. 

FIG. 6A is a sample table &om the electronic program guide 600 m 

10 accordance with a first embodiment of the invention. Specifically, the embodiment of FIG. 
6A presents each program together with the overall recommendation score directly and an 
indication of the most significant contributing attribute. Thus, a user can review the 
electronic program guide 600 and quickly identify the programs having the highest score and 
the most desirable attribute. 

15 FIG. 6B is a sample table firom the electronic program guide 600 in 

accordance with a second embodiment of the invention. Specifically, the embodiment of FIG. 
6B presents each program together with a numerical mapping of the recommendation score 
onto a color scheme, in the manner described above. In addition, each cell provides an 
indication of the most significant attribute that contributes to the overall recommendation 

20 score. It is noted that for a color mapping implementation, a range of scores can be discretely 
mapped to a given color, as discussed above, or a score can be mapped to a color in a 
contmuous fashion. Thus, a user can review the electronic program guide 600 and quickly 
identify the programs with dark green, associated with the mostiy strongly recommended 
programs. 

25 FIG. 6C is a sample table firom the electronic program guide 600 in 

accordance with a thurd embodiment of the invention. Specifically, the embodiment of HG. 
6C presents each program together with a numerical mapping of the recommendation score 
onto a size-of-text scheme, in the manner described above. In addition, each cell provides an 
indication of the most significant attribute that contributes to the overall recommendation 

30 score. Thus, a user can review the electronic program guide 600 and quickly identify the 
programs with a thumbs up symbol (ft) and printed with the largest font. 

The actual intensity or saturation values are computed using well-known 
algorithms in computer graphics. Although RGB (red, green, blue) values are required for the 
display hardware, it is generally easier to determine values according to the HS V (hue. 
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saturation, value) model and then convert tiie result to a RGB representation. First, a hue 
value is selected corresponding to the color chosen for a given range of recommendation 
scores: 



Hue 




Score 


Value 


Color 


Range 


0 


Red 


90-100 


0.160 


YeUow 


80-90 


0.333 


Gieen 


70-80 


0.6 


Blue 


60-70 



5 Saturation is computed from «, the number of programs in the range. If h has a 

value greater than 10, n is replaced by 10. Then, the saturation value is the fraction n/lO. 
Fmally, the velue is fixed at 1 .0. This triple (hue, saturation, value) is flien converted to (red, 
green, blue) according to a well-known algorithm. See, for example, "Fundamentals of 
Interactive Computer Graphics," by J.D. Foley and A. Van Dam, Addison-Wesley Publishmg 

10 Company, ISBN 0-201-14468-9 (1982).It is to be understood that the embodiments and 
variations shown and described herein are merely illustrative of the principles of this 
invention and that various modifications may be implemented by those skilled in the art 
without departing firom the scope and spirit of the invention. 
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1 . A method for displaying available television programs (200), comprising the 

steps of: 

obtaining a list of available programs; 

obtaining a recommendation score (270) for each of said available programs; 

5 and 

displaying said list of available programs to a user with an indication of one or 
more program attributes (240, 245, 250, 255) contributing to said recommendation score 
(270). 

1 0 2. The method of claim 1, v^erein said indication of one or more program 

attributes (240, 245, 250, 255) contributing to said recommendation score (270) provides a 
component score for said one or more program attributes (240, 245, 250, 255). 

3. The method of claim 1, wherein said indication of one or more program 

15 attributes (240, 245, 250, 255) contributing to said recommendation score (270) indicates a 
most significant program attribute. 

4. The method of claun 1 , wherein said indication of one or more program 
attributes (240, 245, 250, 255) contributing to said recommendation score (270) indicates a 

20 predefined number of most significant program attributes (240, 245, 250, 255). 

5. The method of claim 1, wherein said indication of one or more program 
attributes (240, 245, 250, 255) contributing to said reicommendation score (270) utilizes a 
color scheme. 

25 

6. The method of claim 5, wherein said color scheme discretely maps said score 
to a color. 
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7. The method of claim 5, wherein said color scheme continuously maps said 
score to a color. 

8. The method of claim 1 , wherein said indication of one or more program 

S attributes (240, 245, 250, 255) contributing to said recommendation score (270) utilizes a 
variable size-of-text scheme. 

9. The method of claim 1, wherein said indication of one or more program 
attributes (240, 245, 250, 255) contributing to said recommendation score (270) utilizes a 

1 0 variable rate-of-flicker scheme. 



1 0. The method of claim 1 , wherein said indication of one or more program 
attributes (240, 245, 250, 255) contributing to said recommendation score (270) utilizes a 
variable brightness scheme. 

15 

1 1 . The method of claim 1, wherein said indication of one or more program 
attributes (240> 245, 250, 255) contributing to said recommendation score (270) utilizes a 
variable bar height. 

20 12. A system for displaying available television programs (200), comprising: 

a memory (160) for storing computer readable code; and 
a processor (150) operatively coupled to said memory (160), said processor 
(150) configured to; 

obtain a list of available programs; 
25 obtain a recommendation score (270) for each of said available programs; and 

display said list of available programs to a user with an indication of one or 
more program attributes (240, 245, 250, 255) contributing to said recommendation score 
(270). 

30 13. An article of manufacture for displaying available television programs (200), 

comprising: 

a computer readable medium having computer readable code means embodied 
thereon, said computer readable program code means comprising: 
a step to obtain a list of available programs; 
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a step to obtain a recommendation score (270) for each of said available 

programs; and 

a step to display said list of available programs to a user with an indication of 
one or more program attributes (240, 245, 250, 255) contributing to said recommendation 
score (270). 
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PROGRAM DATABASE 
200 





DATE/TIME 
240 


CHANNEL 
2^ 


TITLE 
250 


GENRE 
255 


• 


RECOMMENDER 

SCORE 
270 


205^ 


11/18/99-8:00 
P.M. 


CHI 


LUCY 


COMEDY 




55 


210 


11/18/99-8:30 
P.M. 


CHI 


AL'S FAMILY 


SITCOM 




78 




• •• 












220 


11/18/99-9:00 
RM. 


CH3 


YOUR 
HOUSE 


DRAMA 




96 



FIG. 2 
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USER PROFILE 
400 





RULE 
450 


SCORE 
455 


405 


TITLE = { YOUR HOUSE. WORLD NEWS. MANNEQUIN. 
RUDY. DESIGNING. GOLDEN} 


100.0% 


406 


STATION.CALL^SIGN = WNBX & TITLE = SAT NIGHT 


100.0% 


407 


STATION_CALL_SIGN = WGBX & TITLE = 48 HOURS 


100.0% 


408 


STATION_CALL_SIGN = WNBX & TIME > 6:30 PM 


98.2% 


409 


STAT10N_GALL_SIGN = WABX & TIME > 7:00 PM 


92.6% 


410 


STATION_CALL_SIGN = WNYX & TIME 7:30 PM 


88.2% 


411 


STATION_GALL_SIGN = WPIQ & TIME > 9:30 AM 


86.7% 


412 


STATION_CALL_SIGN = HBO & TIME > 9:30 AM 


79.4% 


413 


ACT0RS1= JOHN SMITH 


100.0% 


414 


GENRE2 = ANIMALS 


99.0% 


415 


TIME >= 4:00 PM & TITLE = BASEBALL 


99.0% 


416 


STATION_CALL_SIGN = TRI 


20.6% 


417 


STATI0N_GALL_SIGN = US1 


24.2% 


418 


STAT10N_GALL_SIGN = VCF 


29.3% 


419 


STATION_GALL_SIGN = WGNDIG 


37.0% 


420 


TIME <= 9:30 AM 


2.0% 


421 


NEW = Y 


82.0% 


422 


DIALOG_RATING = N & NEW= N & TIME <= 6:30 PM 


79.4% 


423 


DEFAULT.= ??? 


0% 



FIG. 4 
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OBTAIN ELECTRONIC PROGRAM GUIDE (EPG) 
FOR TIME PERIOD OF INTEREST 
510 






> 


f 






OBTAIN RECOMMENDATION SCORE FROM 
RECOMMENDER FOR EACH AVAILABLE 
PROGRAM IN TIME PERIOD OF INTEREST 
520 






> 


f 






IDENTIFY ATTRIBUTES CONTRIBUTING TO 
PROGRAM RECOMMENDATION SCORE 
530 






> 


f 




DISPLAY PROGRAM GRID (FIG. 6A-6G) TO USER WITH 
EACH AVAILABLE PROGRAM DISPLAYED TOGETHER 
WITH RECOMMENDATION SCORE (OR A CORRESPONDING 
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